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Abstract 

The time reversal of a completely-positive, nonequilibrium discrete-time quantum 
Markov evolution is derived via a suitable adjointness relation. Space-time harmonic 
processes are introduced for the forward and reverse-time transition mechanisms, and 
their role for relative entropy dynamics is discussed. 

Keywords; Quantum channel, time reversal, space-time harmonic process, operator 
Jensen inequality, H-theorem. 

1 Introduction 

Quantum operations are one of the main mathematical tools to represent generalized 
measurements, noisy communication channels, the action of the environment on quantum 
devices and any other uncertain, quantum-state transformation. The study of quantum 
operations stems from the work of Kraus [16| and it has been extensively developed in the 
operator-algebraic approach to quantum mechanics, see e. g. [7]. If the time evolution 
of a quantum system is given by a sequence of quantum operations, then the associated 
quantum process satisfies the Markov property, namely the future of the process depends 
on the past only trough its present state [18]. We are interested in studying the form 
and the properties of the time reversal of this class of quantum Markov evolution. 

Time-reversal of quantum operations have been explicitly related to Quantum Error 
Correction (QEC) in [3], where the form of a time-reversal for quantum operations has 
been first proposed in a particular case (full-rank state), and used to discuss the perfor- 
mance of error-correcting codes. In [^, this partial time-reversal is used to characterize 
correctable codes. Time-reversal of equilibrium quantum Markov processes has been 
recently discussed in [SI with applications to some thermodynamical models. 
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In this paper, we introduce a mathematical framework for discrete-time stochastic 
processes originating from Nelson's kinematics of diffusion processes [201 I21j . Time- 
reversal for Markovian evolutions entails the Lagrange adjoint with respect to the (semi- 
definite) inner product induced by the flow of probability distributions. We show that this 
also holds for finite-dimensional, discrete time quantum Markov evolutions. Hence, the 
time-reversal of a discrete-time quantum Markov process appears as a peculiar feature of 
a kinematical nature that is common to all Markovian equilibrium and non-equilibrium 
evolutions. 

The main contributions of this paper are the following: (i) We derive the form of the 
backward quantum operation from a general (space-time) adjointness relation, common 
to all Markovian evolutions; (ii) We establish this result in the general case, i.e. also for 
states that are neither full-rank nor stationary; (iii) We explicitly show that the derived 
backward quantum operation not only reverses the state evolution correctly, but among 
the possibly infinitely many maps that do so, it also "preserves" the information about 
the forward dynamics. That is, the time reversal of the time-reversal operation returns 
the original quantum channel on the state support; (iv) We introduce the concept of 
space-time harmonic process and show their central role in entropic evolutions as detailed 
below. 

Time reversal also plays a crucial role in the solution of certain maximum entropy 
problems on path space and in deriving an operator form of the H-theorem (Theorem 
\7A\ for quantum Markov channels. In the above, a key role is played by a suitable class 
of quantum space-time harmonic processes. We show that, following the analogy with 
the classical case, they lead to the Belavkin-Stasevski relative entropy O 1111 113| and 
their properties imply its monotonicity of the under completely positive, trace-preserving 
maps. While the latter result was already known [13], it emerges here as a corollary of 
the properties of space-time harmonic operator processes in a technically much simpler 
framework. 

The paper is structured as follows. In Section [2] we develop a few basic elements of 
Nelson's kinematics [21] for discrete-time processes. This is used in Sectionjsjto derive the 
reverse-time transition mechanism of a Markov chain via a certain adjointness relation. 
Section ["3.2| is dedicated to classical space-time harmonic functions as introduced by Doob 
|10| and to the associated martingales. In Section [4] we proceed to build up the time- 
reversal of a quantum Markov process by following the same path, i.e. by introducing 
a suitable space-time semi-definite inner product for quantum observables. Alternative 
approaches to derive the time-reversal are discussed in Section [5] Section [6] is devoted 
to space-time harmonic processes in the quantum domain and to their key properties. 
The remainder of the paper illustrates the role of space-time harmonic processes for 
information dynamics. After recalling the relevant results for Markov chains in Section 
|7.1[ in Section |7.2| Jensen's operator inequality allows us to derive an H-theorem in 
operator form, in striking analogy with the classical case. In Appendix[B] we sketch some 
connections to maximum entropy problems on path space and related manifestations of 
the second law of thermodynamics. 

2 Elements of Nelson's kinematics for discrete- 
time stochastic processes 

Let / = [fo,ii] be a discrete-time interval with — oo < to < ti < oo. Let {Q,J^,¥) be a 
probability space and let {J^^},t G /, be a nondecreasing family of a-algebras of events 
(filtration) representing a flow of information. Let X : I ^ L^{ft,J^,P) be a second order 
stochastic process such that X{t) is {.7-"j~}-measurable, for all t £ I. Then the conditional 
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forward difference of X is defined by 

A+X{t) = E{X{t + 1) - X{t)\Tt-). 

Consider now a nonincreasing family of cr-algebras of events {J-^},t G I, and suppose 
that X{t) is {jr+}-measurable, Vt G 7. Then the conditional backward diference of X is 
defined by 

A'X{t) = E{X{t - 1) - 

Observe that both A+ X {t) , A~ X (t) e L^(f7,:F,P), Vt. A process satisfying A+X{t) = 
0,Vt G / is called a {^f~}-marim(;aZe if A'^X{t) = 0,Vt G 1, namely if 

E{X{t + l)\Tr) = X{t), a.s. (1) 

It is called a reverse-time, {J^^} -martingale if A^X(f) = 0,Vt G /, namely if 

E(X(t- = a.s. (2) 

If A+X{t) > or A"X(t) > 0, Vt G / then X{t) is called a {.;^+} submartmgale 
and a reverse-time submartingale, respectively. We can say that a martingale is 

conditionally constant and a submartingale is conditionally increasing. An elementary 
example of a martingale is provided by the capital of a player at time t in a fair coin 
tossing game (i.i.d. Bernoulli trials). The capital is instead modeled by a submartingale 
if the outcome he is betting on has chance > | to occur. Notice that the notion of (sub)- 
martingale is usually defined on the larger class of processes X such that E|X(f)| < 
00, Vi G /. Finally, notice that, by iterated conditioning, if X{t),t G / is a {J-^}- 
martingale and Y{t),t G / is a {jr~}-submartingale, then 

EX{s)=EX{t), Vs,tG/, EY{s)<EX{t), V s < t G /. (3) 

Similarly, for reverse time (sub)martingales. A general reference on discrete-time mar- 
tingales is [22] . 

Consider now the family Ti,{to,ti) of second order stochastic processes X such that 
X{t) is simultaneously {jTj" }-measurable and {.7-"(^}-measurable, Vt G I. We then have 
the discrete-time analogue of Nelson's integration by parts formula |21l p. 80]. 

Theorem 2.1 Let X,Y e n{to,ti). Then 

E (X(ti)y(ti) - Xito)Y{to)) = ^ E {A+X{t)Yit) - X{t + l)A-y(t + 1)) . (4) 

to 

Proof. 

ti-i 

E{X{ti)Y{ti) - X{to)Y{to)) = ^ E [X{t + l)Y{t + 1) - = 

t^tg 

fl-1 

J2 E [{X{t + l){Yit + 1) - Y{t)) + iX(t + 1) - Xit))Y{t)] . 

t^tg 

By the conditional expectation properties, we now have 

E{{X{t + 1) - X{t))Y{t)) = E{E{{X(t -f 1) - X{t))Y{t)\T^)) = E{A+ X{t)Y(t)y, 
E{X{t+l)iYit + l)-Y{t))) = E{E{X(t+l)iYit + l)-Ym^t\i)) 

= -EiX{t + l)A-Y{t + l)), 

and the conclusion follows. □ 
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3 Kinematics of Markov chains and space- time 
harmonic processes 

Consider a Markov chain {X{t),t £ Z} taking values in tlie finite set X = {xi,X2, ■ ■ ■ , x^} 
which we identify from here on with the set of the indexes {1, 2, . . . , n}. We denote by nt 
the probability distribution of X{t) over X. In the following, ttj is always intended as a 
column vector, with i-th component TTt{i) ~ ¥{X{t) — i). Let P{t) denote the transition 
matrix with elements Pij{t) = ¥{X{t + 1) = j\X{t) — i),i,j = 1, . . . , n. The matrix P{t) 
is stochastic, namely 

> 0,Vi,Vj, = l,Vi. 

j 

Let us agree that troughout the paper f indicates adjoint with respect to the natural inner 
product. Hence, in the case of matrices, it denotes transposition and, in the complex 
case below, transposition plus conjugation. The evolution is then given by the forward 
equation 

■Kt + l = P\t)-Kt. (5) 

When P does not depend on time, the chain is called time-homogeneous. A distribution 
7f is called stationary for the time-homogeneous Markov chain X with transition matrix 
P if it satisfies 

7f = P^7f. (6) 

For X and y n-dimensional column vectors, we define the semi-definite form: 

{x,y)^^ = x^'D^^y, (7) 

which is an inner product if D^, — diag (7rt(l), 7rt(2), . . . , 7rt(n)) is positive definite. It 
represents the expectation of the random variable Z defined on {X,TTt) by Z{i) — Xiyi. 
In what follows, whenever a matrix M is not invertible, is to be understood as the 

generalized (Moore-Penrose) inverse M*, cf. [nj. 



3.1 Space-time inner product and time-reversal 

Let ,t £ Z be the a-algebra generated by {X(s),s < and to be the cr-algebra 
generated by {X(s), s > t\. Let / : Z x A' ^ R. Let us compute the forward difference 
A'^ f{t, X{t)) with respect to the family {J^^},t > 0, following Appendix [2] We have 
that 

A+/(t,X(f))|^^^j_ =E(/(t-fl,X(f+l))-/(t,X(t))|X(t) =i) = 

j 

(8) 

Henceforth, we shall denote by ft and A^/t the column vectors with i-th component 
f{t,i) and A+/(i, , respectively. We can then rewrite (jsjl in the compact 
form 

A+/t = P{t)ft+i - ft. (9) 

Consider now the vector space 

K. = {f : Z X X ^ R\3to,ti,to < ti s. t. f{t,i) = 0,\fi,t ^ [to, ti]}, 

namely the set of functions with finite support. For f,g £ K,, we define the semi-definite 
space-time inner product as 

oc 00 00 

</,5)^= E Ut.9t)., = J2 ftD.^gt,^ Yl m{t,X{t))g{t,Xm, (lO) 
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where n ~ {-Kt , t G Z} denotes the family of the Markov chain distributions. We then 
have the foUowing Corollary to the "integration by parts" formula of Theorem |2.1[ 

Corollary 3.1 Let f,g e)C. Then 

{A+f,g}^ = {f,A-g}^ (11) 

Proof. By Theorem [2l| 

OC OO 

J2 E(A+/(t,X(f))p(t,X(f))) = J2 E(/(t + l,X(f + l))A-g(t+l,X(i + l))) 

t — — OO t— — OO 

OO 

= J2 {fs,^'9s}.^, (12) 

S — — OQ 

since the boundary terms are zero. □ 



In view of relation (111, we call A~ a (•, ■).n--adjoint of A . Hence, the two conditional 
differences are adjoint with respect to the semi-definite space-time inner product. On the 
other hand, by using we get 

OO OO OO 

J2 E{A+f{t,x(t))g{t,xm= J2 E^^/(*'^w)ixw.,ff(i'»v»w= E 

£ — — OO t— — OO i t — — OO 

OO OO OO 

t — — OO t — — OO i — — OO 

OO OO 

= E fI+iD.,+iD~^\iP^it)D^,gt- J2 fl+iD.,+,gt+i 

t— — oo t— — oo 

OO 



Let vrt(i) > for all t,i. In this case, (10 



adjoint is unique. By comparison with ( 12 



is an inner product and the corresponding 
we conclude that 



A-fft+i = D-l^P^it)D^,gt-gt+i. (13) 
More explicitly, defining the matrices 

Q{t) = D-^\^P\t)D^„ (14) 
relation ( |13| l reads component-wise 

A-g{t + 1, X{t + 1))l^(,+„^^ = Eig{t, X{t) - g{t + 1, X(t + l))\X{t + 1) = j|15) 

= E5(*'*)*'W-5'(*+l'j')- (16) 

i 

Hence, Q{t) is simply the matrix of the reverse-time transition probabilities. Of course, 
Q can be obtained immediately by requiring that the two-time probabilities generated 
by the forward and backward Markov chains are the same: 

¥(X{t) = i,Xit + l) ^j) ^p,,{t)ntii) = qj.7Tt+i{j). (17) 

This yields immediately 



5 



which can be compactly rewritten in the form (141. 

Two remarks are in order: (i) The backward transitions are time-dependent even 
when the forward are not. (ii) When 7rt+i(j) = 0, qji{t) may be defined arbitrarily to 
be any number between zero and one without actually affecting relation (171, provided 
it satisfies the normalization condition 



Notice then that ( 13 1 leads to the correct form of the time-reversal even if the distri- 
butions {TTt} are only non-negative. The derivation of Q using the A~ operator, albeit 
much longer, permits to see that the reverse time transition mechanism may be viewed 
as a space-time adjoint to the forward one with respect to the flow of probability distri- 
butions {nt,t £ Z}. The space-time adjointness relation (111 for Markov chains admits 
an equivalent, compact formulation. 

Proposition 1 The space-time adjointness relation ( |11[ | holds if and only if the two- 
time relation 

{P{t)x, y)^, = {x, Q{t)y)^,+, , X, 2/ G r\ (18) 

is satisfied at any t. 



Proof. It is immediate to verify that the form of the time-reversal transition matrix ( 14 1 
implies (181. On the other hand, if (181 holds, we have 

{ft+i,D:^l^^P\t)D^tgt~ gt+i)T.t+i = ^ {/t+i, Q(i)5t - St+O^rt+i (19) 

t — — OO t— — OO 

OO OO 

= Y {P{i)ft+i,gt)^t - Y {ft+i,gt+i)nt+^ 

t— — OO t — — OO 

OO OO 

£ — ~oc t— — OO 

OO 

= E {Pit)ft+i-ft,9t}.,. 

t — — OO 

□ 

Relation ( |18[ ) will serve as a useful guideline to derive the reverse-time transition mech- 
anism for quantum channels in Section |4] since in that setting we cannot generally relay 
on conditional probabilities as in (|17l). 



3.2 Space-time harmonic processes 

^From here on, we only consider Markov chains X = {X{t),t > 0} with values in 
X ^{l,2,...,n}. 

Definition 3.2 A function ft : N x A* — > R is called space-time harmonic on [to,ti] for 
the transition mechanism {P{t); to < t < ti} of a chain if, for every to < t < ti — 1 and 
all i £ X, it satisfies the backward equation 



(20) 



The concept of space-time harmonic function can be introduced also with respect to a 
reverse time mechanism. Indeed, let qji(t),t > be the reverse-time transition proba- 
bilities of the Markov chain X = {X{t);t G N}. Then 9 is called reverse-time harmonic 
with respect to qji{t),t > if it satisfies 

= yt>0,\/i,j €X. (21) 

i 

Space-time harmonic functions, a terminology due to Doob and motivated by diffusion 
processes, play a central role in constructing Schrodinger bridges for Markov chains |27| . 
They are closely related to a class of martingales that are instantaneous functions of 
X(t). Let, as before, ^jT denote the a-algebra induced by {X{s),s < t}. 

Proposition 2 Let h be space-time harmonic on [to,ti] for the (transition mechanism 
of the) Markov chain X = {X{t);t £ N} with state space X and transition matrix 
P{t) = (pijit)). Define the stochastic process Y — {Y{t) = h(t, X{t)),to < t < ti}. 
Then, Y is a martingale with respect to {J-^ ,to < t < ii}. 

The proof is a straightforward generalization of Bremaud |8l p. 179]. By Jensen's in- 
equality [29], we have the following way to generate submartingales from martingales. 

Proposition 3 Let Y — {Y{t),t > 0} 6e a martingale with respect to the filtration 
{J-t,t > 0} induced by the past of the Markov chain X = {X{t),t > 0}. Let if he a 
convex function and define Z{t) := ip{Y(t)),t > 0. Then Z is a submartingale with 
respect to {J-t,t > 0}, namely 

E(Z{t+l)\J^t)> Z{t), a.s. 

4 Time-reversal for quantum Markov channels 

Consider an n-level quantum system with associated Hilbert space Ti. isomorphic to 
C". In its standard statistical description, the role of probability densities is played by 
density operators, namely by positive, unit-trace matrices p £ T>{Tl). The role of real 
random variables is taken by Hermitian operators X G OiTL) representing obervables. 
Expectations are computed via the trace functional, Ep(X) = trace(pX), and the classical 
setting may be recovered considering all diagonal matrices. Any linear. Trace Preserving 
and Completely Positive (TPCP) dynamical map acting on density operators can be 
represented by a Kraus operator-sum [16], i.e.: 

i j 

Following a quite standard quantum information terminology, we refer to linear, completely- 
positive trace-non-increasing Kraus maps as quantum operations. The adjoint action of 
a quantum operation with respect to the Hilbert-Schmidt inner product, i.e. the expec- 
tation, is immediately found: 

tia.ce(X£''{p)) = trace (X ^ MjpMj) = trace(^ MjXMjp) = trace(£'(X)p). 

For observables, the dual dynamics is thus given by the identity-preserving quantum 
operation 

^(X) = ^MjXMj. (22) 
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In the remaining of the paper, we consider the discrete-time quantum Markov evolutions 
associated to an initial density matrix po and a sequence of TPCP maps {£j}t>o- 

In order to find the time-reversal of a given Markovian evolution, rewrite the probability- 
weighted inner product of the classical case ^ as (a;, y).^ = tiace{DxD^Dy). Notice that, 
if we simply drop commutativity, for two observables X, Y and a density matrix p, we 
would obtain {X,Y)p = trace(Xpy). This functional is not satisfactory to our scopes, 
since in general it is neither real nor symmetric, i.e. trace(ypX) 7^ trace(Xpy). It 
is then convenient to rewrite by using the fact that all matrices commute, in the 
symmetrized form: 

{x, y)^^ trace(IP| D| DyD^ dI ). 
We shall show that this form of the inner product leads to the correct reverse-time 
quantum Markov operation. Allowing for a general density operator p and observables 
X, Y, we thus define: 

{X, Y)p = trace(X5p5Fp5X3). 
This is a symmetric, real, semi-definite sesquilinear form on Hermitian operators. 

By analogy with the classical case, we then define the quantum operation TZe.pt as 



the space-time {pt}-adjoint of a quantum operation £ using the quantum version of ( 18 1: 

(f(x),y)p, = {x,7^£,p,(y)) 

Pt+1- 

Let us assume for now that pt+\ is full-rank. An explicit Kraus representation is then 
obtained as follows: 

{£{X),Y)p, = Y.^rs.ce{M]XM,plYph 

j 

= trace(Xp,%p7+\ M,p,5 Y p^ M] p~+\p'^+^) 
i 

= Y.^rs.ce{XpJ+^R]{£,pt)YR,{£,pt)p^^^) 
3 

= {X,7^£,p,(Y))p,+,, 
where TZs^p^ admits an operator-sum representation with Kraus operators 

R,{£,Pt) = p;+\M,pl. (23) 

Notice that the second equality is non-trivial in the case when pt+i is not full-rank and 
inverses are replaced by the Moore-Penrose pseudoinverse (the latter replacement will be 
tacitly assumed in the rest of the paper). For any matrix M, the support of M , denoted 
supp(M), is the orthogonal complement of ker(M). The following lemma ensures that 
the same derivation applies to the general case. 

Lemma 4.1 Let pt+i = X]j MjPtM^ . Let Hp^^^ denote the orthogonal projection onto 
the support of pt+i. Then, for any normal matrix Y : 

Hpt+i {^M.pjYplM]^ Dp,^, =^A/,p*yp?M;. 

1 

Proof. If we consider a spectral representation for p^ = "^f. y/pk\ak) (,ctk\, we have that, 
for any \y): 

J2M,pf\y){y\plM] = J2^^^J2VP^M{ak\y}{y\at){a,\M] 

3 3 k.l 

= 'Y 'Y VPkPi VkjMj I afc ) (q; 1 Ml , 

3 k,l 
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where t/fe,; = {ak\y) {y\ai) . Since pt+i = 1]^,^ PfcA^j l^fc) (afc|Mj it must be np^^^Mjlofe) = 
for aU j,k. Hence 

3 

and the statement holds for rank one Y — \y){y\. By linearity it extends to any normal 
matrix. □ 

It is now natural to define a transformation between Kraus operators. Let £^ be a 
quantum operation represented by Kraus operators {-Ffc}. For any p, define the map Tp 
from quantum operations to quantum operations 

Tp : ft ^ Tp(£t), (24) 

where 7^(ft) has Kraus operators {p'i Fl{£(p))^^}. The results of show that the 
action of Tp is independent of the particular Kraus representation of f^. With this 
definition, we have that 

t,A£')='T^Ip,- 

We are now in a position to prove the main result of this section, which establishes 
the role of TZe,pt{') SiS the quantum time-reversal of the TPCP map £^ . Augmenting a 
Kraus map £ with Kraus operators {Mk}k=i,...,m to a TPCP map means adding a finite 
number p of Kraus operators {AI^} k=m+i m+p so that Efc MlMk = I. 

Theorem 4.2 (Time Reversal of TPCP maps) Let £^ be a TPCP map. If pt+i = 
ft(pt), then for any pt € DiTL), 7?.^ = Tp^[£'^) defined as in (231 is the time-reversal 
o/f t for pt, that is, it satisfies both: 

Pt=T^l,pM+^) (25) 

and: 

^P*+i(7^^,pJ('^t)=f^K), (26) 
for all at G D{Ti.) such that supp((Tt) C supp(pt). Morover, it can be augmented to be 
TPCP without affecting property (25 1 -(26 1. 

Proof. By direct calculation: 

Tzljpt+i) = j2pt^^3PtApt+ip:AM3pl 

3 

= J2ptM^jTlp,^,M,pl. 

3 

If pt+l is full-rank we are done, since Mj Mj = I. If this not the case, consider an 
orthonormal basis {jctfe)} for ker(pt+i). Observe that: 

= (Qfclpt+iiafe) = {ak\J2^3PtMj\ak}, 

3 

which implies M^\ak) G ker(pt), Vj, k. Now decompose the identity operator as follows: 

3 3 3 k 

and multiply on both sides by IIpj. Since AfJ|afe) G ker(pt), we obtain: 

Hp, =^np,AfJnp,^,M,np,. 
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Hence Y., P? M]n,^^,M,pJ = p^. 

. 1 J. _i 

In order to prove ( |26[ ), recall that Tl,\ admits Kraus operators Rj{£, pt) ~ Pt -^^^Pt+i- 

If we explicitly compute Tp^j^-^ {TZ\ we get a quantum operation with Kraus operators 

p^+,R]{£,pt)p';'^ =pl+,{p';j,Muphp't'^ -^Pt^^Mu^p,. 

Hence, if Ylp^atHpf — cTt by Lemma [4. 1| we get: 

Tpt+iiT^l,p,){'^t) = ^Ilp,^,AhIlp,atnp,Mlnp,+i =^M^np,atap,Ml = £\at). 
k k 

In general, TZ\ is trace-non-increasing, since: 

Y,R]{£,Pt)R,{£,Pt) = p';+\Y.^^^P^^lp~ti^ 

3 3 

If pt+1 is full rank, then TZ\ is trace preserving. If this is not the case, we can always 
"augment" 7?.|. with some additional Kraus operators Rj that satisfy: 

3 

SO that the augmented 7?.]- is trace-preserving and does act as the time reversal on pt+\ . 
To do so, it suffices for example to consider an orthonormal basis for ker(pi_|.i), 

and define Rj = | /3j ) (ft | . □ 



Remark: Property (261 ensure us that among all quantum operations mapping pt+i 
back to pt, TZg is the natural time-reversal of £^ with respect to pt- In fact, notice 
that if pt is full rank, \2G\ implies that T^j^^ o Tp^ is the the identity map on quantum 
operations. That is, as one would expect, the time reversal of the time-reversal is the 
original forward map. While this may seem obvious, notice that property (25 1 alone is 
satisfied by any quantum operation of the form 

= Tp,(:F^), 

with T'' any TPCP map. 



5 Other approaches to Quantum Time-Reversal 

Reversibility issues for quantum operations have been related to QEC from its beginning 
to the most recent approaches, see e.g. [241 1151 fTTl [6]. While studying quantum error 
correction problems, the same T?.^ p(-) has been suggested by Barnum and Knill as a near- 
optimal correction operator [^. They introduce the explicit form of TZ\ by analogy 
with the error correction operation for subspace codes. The correction operation for a 
TPCP map with Kraus representation {Mk} features Kraus operators {HcM^/y^}. 
Here He is the orthogonal projection on the subspace code, and MfcHc = ^JpkVk has 
to hold for some probabilities {pk} and isometries Vk on orthogonal subspaces. In their 
setting, £\p) is assumed to be full-rank, and represents the output of a channel f ^ with 
input state p = YjPjpj, a statistical mixture of some quantum codewords of interest to 
be recovered. TZ\ ^{■) is then shown to satisfy T?.]- p{£^ (p)) = p- It is also proven there 
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that the reversal is independent of the particular Kraus representation of a fact that 
we used in the previous section to introduce Tp. 

Another approach, which is strictly related to our work in |27) . is based on the fact 
that density operators pt,pt+i can be interpreted as classical probability distributions 
over their spectral families of orthogonal projectors. Each set of orthogonal projectors is 
a complete family of commuting quantum events that generates an abelian algebra. We 
can thus study the transition probabilities between the elementary events of the abelian 
algebras generated by pt,pt+i following the analogy with the classical case. In fact, if 
we write pt = "^ZiPi^t.i, Pt+i ~ qjYlt+i,j, we have that the probability of measuring 
IIj,t+i after Tli^t has been measured at time t and £^ acted on the system, is given by: 

p(n,,t,nj,t+i) = trace ^n^-t+i (^Mkn,,tptn,,tMl^ n^.t+ij , 

= trace(^n,,t+i(^Affcn,.tMt)nj-t+i)p„ (27) 

k 

obtaining an analogous of the transition probabilities in the classical case. The reverse- 
time TZl; is then required to be such that: 

p(n,,t,nj,t+i) = trace(^n,,t^i?fc(£:,pt)n,,t+ii?I(f ,pt)nj,t)gj. (28) 



From (27 1, using the cyclic property of the trace and the fact that pt+i and 11 



commute for all j, we get: 

p(n,,t,nj,t+i) = ^trace(n,,t+iMfcn,,tptn,,tAftnj,t+i), 



= tTa.ce(ni,tp? Mlpt^\Tlj,t+iPt+iIlj,t+iPt+iMkp^ n^,*^ , 

k 

= trace(n,,t J^iPt' Mlp;+\)U,,t+i{p;AM,pl)Tl,,t^q,. 



This shows that TZg we derived before satisfies ( 28 1 . This property has been used in 
|27| to intuitively derive the form of TZ^ , where the time-reversal has been proved to 
be a key ingredient to solve maximum entropy problems on quantum path spaces. In 
Appendix [B] we outline some connections between the material presented in this paper 
and Theorem 6.5 in [57]. 

Yet another possibility to approach the time-reversal is offered by the interpretation 
of a TPCP map in Kraus form as a non-selective generalized measurement (see e.g. [23]). 
General, indirect quantum measurements cause the initial state pt to "collapse" onto one 
of the conditional density operators: 



Pk — 



trace(M2 Mfept 



■MkptMl, 



with relative probabilities p{k) = trace(Mj^Mfcpt), for some J]]^. M^Mk = One can then 
think of £{pt) ~ 'Ylk Mk{pt)Ml as the state conditioned after a non-selective quantum 
measurement with outcomes labeled by k, i.e. a measurement with unknown outcome. 
We can then look for a sort of reverse-time measurement process, namely a quantum 
operation that has the same reverse transition probabilities. Define as above pt+i — 
£{pt)- We look for a trace-preserving TZe,pt{') ~ l^k ^^iS, pt){-)Rli£, Pt) such that: 

U&ce{MlMkPt) =p{k) = trace{Rl{£, pt)Rk{£, pt)pt+i). 
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By using again the cychc property of trace, we get: 

p{k) = trace(Af^A'/fept) = tra,ce{p^^\MkPtMlp^^-^pt+l), 

which suggests to the same form of the time reversal map we obtained in the previous 

section, namely Rk{£, pt) = Pt ^kPt+i - This can be seen as a simplification of the three- 
time derivation proposed in |^ for quantum operations at the equilibrium. 



6 Quantum space-time harmonic processes 

While in the framework of quantum probability rigorous extensions of conditional ex- 
pectations and martingale processes are available for quite some time |30l 111 [25l 118] . we 
show here that quantum analogues of the results of Section |7.1| below can be derived 
avoiding most of the related technical machinery. This can be accomplished by introduc- 
ing a quantum version of space-time harmonic functions. Consider a reference quantum 
Markov evolution on a finite time interval, generated by an initial density matrix po and 
a sequence of TPCP maps }tg[o,T-ii • 

Definition 6.1 (Quantum space-time harmonic process) A sequence of Hermitian 
operators {Yt}t£[o,T-i] is said to be space-time harmonic with respect to the family of 
identity-preserving maps {£t\te[o,T-i] */•' 

Yt = et{Yt+^). (29) 

In analogy with the classical case, {Yt}te[o,T~i] is said to be space-time harmonic tn 
reverse-time with respect to the family {7?.£r.pt} if- 

=7^£„p,(F0• (30) 

The sequence is called space time subharmonic if Yt < £t{Yt+i), where we are referring 
to the natural partial order between Hermitian matrices, see also Section [A] Similarly in 
reverse time. 

In the classical case, space time harmonic functions generate changes of measure 
through multiplicative functional transformations of the transition mechanism. A similar 
fact holds in the quantum case. Let Yt be space time harmonic for St ~ {-Bfe(t)^} and 
let Nt be any choice of operator such that Yt = NtN^ . Assume for simplicity Yt to 
be full-rank at any t. Then J^t ~ {Nt~^ ^k{t)^ Nt+i} is an identity-preserving quantum 
operation. In fact, by using (|29[), we have: 



:FtiI) = ^iVr'i5fc(i)^iVt+iiV,Vii5fc(f)iVr^ = /. 

k 

Thus its adjoint is a TPCP map. An analogous result holds for reverse time evolu- 
tion. The following result is the quantum counterpart of ([3| concerning properties of 
expectation of (sub)martingales. 

Proposition 4 Let {Yt}t£[o,T-i] be space-time harmonic and let {Zt}t£[o,T-i] be space- 
time subharmonic with respect to the reference evolution. Then, for all t £ [0, T — 1] ; 

Ep„(yo) = Ep,(rO, ^PtiZt) < Ep,^,iZt+i). (31) 



Proof. Using (29 1, we have 



trace(pt+iyt+i) = tra.ce(£} (pt)Yt+i) = trace(pt£'t(yt+i)) = trace(ptY't). 
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We then get (311 by iterating the above calculation. Similarly, 

trace(pt+iZt+i) = trace(f/(pt)^t+i) = ti-ace{pt£t{Zt+i)) > trace(ptZf). 

□ 

We are now ready for the quantum counterpart of Proposition [S] 

Proposition 5 Let Yt be a space-time harmonic process with respect to {£t}t>o, with 
eigenvalues \t,i £ I C at all times, and f : X M. be operator convex. Then Zt ~ 
,f(Yt) is space-time subharmonic. 

Proof. By Definition |6 . 1 1 and Theorem |A.l[ we obtain: 

Zt = f{Yt) = fi£tiYt+r)) < £tifiY+i)) = £t{Zt+i). 

□ 



7 Application to thermodynamics 

7.1 Classical results: Space-time harmonic functions and a 
strong form of the H-theorem 

As first observed by Doob |10| , the ratio of two solutions of a forward equation ([5| yields 
a space-time harmonic function for the reverse-time transition mechanism. Indeed, let 
{nt,t > 0} and {pt,t > 0} both satisfy equation ([5|, with nt{i) > 0,Vi,fo < t < t\. 
Let qji{t) denote the reverse-time transition probabilities corresponding to the initial 
condition 7r(0). Define the function 

e(i,i):=^. (32) 

Then, using ([13| and Is), we get 

Y,qUt)e{t,i) = Y. = o{t + i,j), (33) 

namely 9 is space-time harmonic on [to,ti] with respect to the reverse-time transition 
mechanism qjiit). In view of Proposition [2] it follows that the process Y{t) :— 6{t,X{t)) 
is a reverse-time martingale with respect to the "future" filtrations {Qt = a-{X{t), X{t + 

l),...),to<t<tl}. 

Theorem 7.1 Under the above assumptions, the stochastic process Z (t) :— — logy(t) := 
— log6{t,X{t)) is a submartingale with respect to Qt,to < t < ti in the reverse time di- 
rection. 

Proof. Observe that — log is a convex function and invoke Proposition [3] □ 

We now show that Theorem |7. 1| implies a local form of the second law. Indeed, consider 
a time-homogenous chain with forward transition matrix P. Let vf be a stationary distri- 
bution for the chain, namely P''Tt — n. Let nt be another solution of the corresponding 
forward equation ([5|. Assume TVt{i) > 0,Vi,Vf > to- Then, as observed before, 

., Tt(i) 

e{t,i) = ^,t>to, 
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is space-time liarmo nic o n t > to with respect to the reverse-time transition mechanism 
qjiit). By Theorem 7.1 the process Z{t) := —logO{t, X{t)) is a submartingale with 



respect to Qt,t > to (conditionally increasing) in the reverse time direction. Hence, we 
have the following strong form of the second law. 

Theorem 7.2 Under the above assumptions, we have 

E{-\oge{t,X{t))\gt+i)>-log9{t + l,X{t+l)), a.s.. (34) 

This stronger form of the second law was apparently first presented for diffusion processes 
in [26]. We finally observe that the usual second law can be obtained as a consequence 
of this result (Corollary 7.3 below). Let us first recall the definition of relative entropy. 
Let p and q be probability distributions on a finite or countably infinite set. We say 
that the support of p is contained in the support of g if = pi = and write 
supp(p) C supp(g). The Relative Entropy or Information Divergence or Kullback-Leihler 
Index of q from p is defined to be 

D(p||g) = / i:.P»logiy' supp(p) C supp(g), _ ^3^^ 
[ +00, supp(p) g supp(g). 

where, by definition, ■ logO = 0. 
Corollary 7.3 D(7rt||7f) is nonincreasing. 



Proof. We take expectations in ( 34 1. By the iterated conditioning property and observing 
that 

E,(0)(-log#(t,X(t)) = ^log^7ri(i) =D(7ri||^), 
^ — ' nit) 

i 

we get 

D(7rt+i||7f) <D(7rt||7f). 

□ 



7.2 Relative entropies and a quantum H-theorem 

The usual definition of quantum relative entropy is due to Umegaki |32| . Given two 
density matrices p, cr, the quantum relative entropy is defined as: 

^ I trace(p(logp - log a)), supp(p) g supp(a), 

^ " ' -l-OO, Supp(p) g Supp((T) ^ ' 

As in the classical case, quantum relative entropy has the property of a pseudo-distance 
(see e.g. [231 f33j '). Moreover, it has been proven by Petz that it is the only functional in 
a class of quasi-entropies having a certain conditional expectation property [28] . 

Nonetheless, here we show how a different quantum extension of classical relative en- 
tropy is natural from the viewpoint of space-time harmonic processes and the dynamical 
structure of Markovian evolutions. In the classical case, we have that KuUback-Libler 
relative entropy between two probability densities pt,7rt can be obtained as: 



E^,{e{t,x{t))\og{e{t,x{t))) = ^^,(i)^iog ^ , (37) 



where 6{t, i) — ^^44 is space-time harmonic in reverse time if pt, vrt evolve with the same 



forward transition mechanism, see (32h(33l 



We now introduce a class of space-time harmonic quantum processes that are the ana- 



logue of those in (32 1. Consider two quantum Markov evolutions, corresponding to 
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different initiai conditions po 7^ fo, but with same famiiy of trace-preserving quantum 
operations {Sj}- Define tlie observable 

Yt^a;--pta;K (38) 

We tlius liave tliat: 

7^£,., {Yt) = Yl ^t+iMk4 " Pt^t " 4 Mia;}, = . (39) 

k 

Tliis stiows tliat Yt evolves in the forward direction with the backward transition mecha- 
nism of at , which makes it quantum space-time harmonic in reverse time with respect to 



the transition of at. In view of (371 and (38 1, the natural definition of relative entropy 



in our setting is thus the Belavkin-Staszewski's relative entropy 5 : 

Dss(plk) = trace (^a (^a^^ pa^^^ log (^a^^ pa^^^^ , (40) 

where, as usual, OlogO — 0. As for the Umegaki's version, it enjoys the properties of a 
pseudo-distance: It is non negative and equal to zero if and only if p = o". The proof is 



immediate by using (48 1. In addition to this, it is clearly consistent with the classical 
relative entropy, which is recovered by considering commuting matrices, and with the 
von Neumann entropy, since: 

Dss(p||/) = trace(plog(p)). 

Another useful property has been proven by Hiai and Petz [13) : 

nBs{p\\a)>Bu{p\\a). (41) 

Hence, convergence inDss(p||(T) ensures convergence in D[7(p||cr). The Belavkin-Staszewski's 
relative entropy has also been shown to be the trace of Fuji-Kamei's operator entropy 
|11| . As a consequence of the results of Section [g] we have the following Corollary. 

Corollary 7.4 Consider two quantum Markov evolutions associated to the initial con- 
ditions po 7^ ao and to the same family of TPCP maps {£}}■ Suppose that pt,at are 

invertible, for all t's. Let Yt — ctj ^PfCTj ^ and let Zt := g{Yt), with g{x) = a::log(a;). 
Then Zt is a reverse time, space-time subharmonic process with respect to the quantum 
operations {'Tle,rTt{-)}, i-s- 

Zt+i = 9 (Ft+i) < 7^£,.. {g {Yt)) = TIE,., {Zt) . (42) 



Proof. Recall that, in view of (39 1, It = ^ ptat ^ is space-time harmonic in reverse 

— _ 1 _ 1 

time with respect to the quantum operations {7?.£,o-t (■)}• Observe that ctj ^ ptOt ^ has 
(real) eigenvalues in (0,-1-00). Observe moreover that the function g{x) — 3::log(a::) is 
operator convex on (0, 4-oo) (see ;4, Exercise V.2.13]). The conclusion now follows from 
a reverse-time version of Proposition [5] □ 

This can be seen as an H- Theorem in operator form: In fact, as in the classical case, 



the reverse time subharmonic property of {Zt} of Theorem 7.4 implies under expectation 
a more usual, Lindblad-Araki-Uhlmann-like [191 [21 [31] form of the i/-theorem. Namely, 
we obtain monotonicity for the Belavkin-Staszewski's relative entropy under completely 
positive, trace-preserving maps. The same result has been derived for conditional expec- 
tations in [13] . 
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Corollary 7.5 Consider two quantum Markov evolutions associated to the initial con- 
ditions po 7^ Co, and to the same family of TPCP maps {Sl}- Assume that pt,o-t are 
invertible for all t 's. Then: 

BBs{pt+i\Wt+i) < BssiptWat). (43) 

_ 1 _i 

Proof. Let Yt = ^ pta^ ^ as above. By Theorem 

^Bsipt+i\\o-t+i) = trace ((Tt+ig(Y't+i)) 

< trace {at+iTZe,at {g{Yt))) (44) 
= trace (7^t,,^(at+l)<7(yt)) =Dfls(pt||aO. (45) 

□ 

If a is the unique stationary state of {S^}, we get a quantum version of the second law. 
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A Operator Jensen's Inequalities 



We recall here some basic definition and results from the theory of majorization for 
Hermitian operators on C*-algebras, restricted to our finite-dimensional setting. We 
refer to [4] Chapter 5] for a thorough discussion on related topics. 

Positive, Hermitian matrices are endowed with a natural partial ordering, that is 
A < B if (^l^l^) < {<I)\B\<I)) for every £ Ti. Since the spectral theorem applies, if the 
spectrum of A is contained in some interval T C R, we can define the action of a real 
function / : X — > R on Hermitian matrices by standard functional calculus: 

./(^) = ,/(E^^n,) = ^/(A,)n„ 

for any A^ = A — ■ -^jllj) G ^ for all j's. A function / is called operator convex 
if f{XA + (1 - X)B) < \f{A) + (1 - A)/(B), for any A G [0, 1], and matrices A, B with 
spectrum in T. Consider now a set of operators {A'lk}, such that Mj,Mk = I- Then, 
for every tuple {X^} of self-adjoint matrices, the operator sum MlX^Mk can be 
thought as an "operator convex combination" of the {Xt}- Remarkably, an operator 
analogue of Jensen's inequality [29] holds (see [12] and reference therein for a review of 
the literature on the subject). We give here a reduced statement of Theorem 2.1 in [T2] 
which is sufficient to our scope. 

Theorem A.l (Operator Jensen's Inequality) A function f : I —> M. is opera- 
tor convex if and only if for any Hermitian X and set of operators {Mfc} such that 
J2k MlMk = I it satisfies 

f{J2 MlXkMk) < J2 Mlf{Xk)Mk. (46) 

k k 

Trace Jensen's inequality then follows as a corollary. 

Corollary A. 2 (Trace Jensen's Inequality) Let f : I ^ M. be operator convex. 
Then: 

trace(/(EMtXfcMfe)) < trace( ^ Mt/(Xfe)Mfc.) (47) 



It can be shown that, for (471 to hold, / suffices to be convex [12;. Another version 
of Jensen's inequality under trace is related to the contractive version of the Jensen's 
operator inequality (|12). Corollary 2.3), where the requirement on the {Mk} is relaxed 
to MlM, < I. 

Proposition 6 (Expectation Jensen's Inequality) Let f : X ^ M. he convex (not 
necessarily operator convex). Then: 

trace(p/(X)) > /(trace(pX)). (48) 

B Second Law and Maximum Entropy on Quan- 
tum Path Space 

The theoretical framework and the results we developed in this paper are closely related 
to maximum entropy problems on path-space we studied in |27) . We recall in the following 
the main ingredients and the relevant result. 

Consider a quantum Markov evolution for a finite dimensional system Q with asso- 
ciated Hilbert space TLq, generated by an initial density matrix ctq and a sequence of 
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TPCP maps {£}}t£io t-i], with each admitting a Kraus representation with matrices 

We define a set of possible trajectories, or quantum paths, by considering a time- 
indexed family of observables {Xt}, Xt = "127^1 ^i^ii'^)^ with t £ [0,T]. The paths are 
then all the possible time-ordered sequences of events {Ilig (0), Tli^ (1), . . . , 11;^ (T)) , with 
it € [1, mt]. The joint probability for a given path is then given by: 

t^fio,n,....»T)('^o) = trace (n.^(r)4_i(n,^_, (T - 1) . . . (n.„ (o)aon.„ (0)) . . .)n,:^(r)) . 

(49) 

Consider now a situation in which we have a reference process case where the initial 
state is ao and the transitions are given by {S^}. We can look for a process with a different 
initial density matrix which minimizes releative entropy on path space. Assume Xo to 
have non-degenerate spectra. In STl we proved the following. 

Theorem B.l A solution to the problem: 



mmimize 



Kt«^(po)|h^(ao)); (50) 

with ui'^(po) the path space probability distribution induced by a family of TPCP maps 
{^1} and initial state po, is given by the quantum Markov process with initial density po 
and forward transitions: 

Tt{-)^£t{-), \fte[0,T-l]. (51) 

The total cost then depends only on the initial condition and can be bounded by 
D(7(po||o"o)- Altough one would expect the problem solution to depend on the choice 
of the quantum path-space, it turns out to be independent from the choice of the observ- 
ables {Xt}te[o,T]- This shows how, given any path space and any pair of intial conditions, 
two quantum Markovian evolutions generate "trajectories" that are the closest in relative 
entropy if they evolve according to the same transition mechanism. In particular, if the 
reference evolution cor respo nds to a a which is the unique stationary density for the tran- 



sitions {S}}, Theorem B.l can also be interpreted as a generalized form of the second 
law of thermodynamics. Moreover, this result establishes a link between the dissipa- 
tive behavior of an underlying quantum dynamical system and the classical trajectories 
associated to any sequence of measurements on the system itself. 
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